Imaging and display system and method

ABSTRACT

An apparatus for simultaneously recording a first live video stream and projecting a second live video stream onto an interactive touch screen, the apparatus comprising (a) a backlight panel; (b) a horizontally polarized screen associated with one face of the backlight panel; (c) a camera having a lens, the camera having controllable frame rate and exposure; and, (d) a LCD screen.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of co-pending U.S. patent applicationSer. No. 15/174,085, filed Jun. 6, 2016, entitled Imaging and DisplaySystem and Method, which claims priority to U.S. Provisional PatentApplication Ser. No. 62/171,763, filed Jun. 5, 2015, entitled Imagingand Display System and Method, the disclosures of which are incorporatedherein by reference in their entireties.

FIELD

The present disclosure relates, in exemplary embodiments, to apparatusand methods for recording and projecting video images onto and throughan interactive touch screen.

BACKGROUND

The present disclosure relates, in exemplary embodiments, to apparatusand methods for recording and projecting video images onto and throughan interactive touch screen.

SUMMARY

The following presents a simplified summary in order to provide a basicunderstanding of some aspects of various invention embodiments. Thesummary is not an extensive overview of the invention. It is neitherintended to identify key or critical elements of the invention nor todelineate the scope of the invention. The following summary merelypresents some concepts of the invention in a simplified form as aprelude to the more detailed description below.

Generally described, the present disclosure provides in a firstexemplary embodiment, an apparatus for simultaneously recording a firstlive video stream and projecting a second live video stream onto aninteractive touch screen, the apparatus comprising (a) a backlightpanel; (b) a horizontally polarized screen associated with one face ofthe backlight panel; (c) a camera having a lens, the camera havingcontrollable frame rate and exposure; and, (d) a LCD screen.

The present disclosure also provides, in a second exemplary embodiment,a system for simultaneously recording a first live video stream andprojecting a second live video stream onto an interactive touch screen,the system comprising: (a) a first apparatus comprising, (i) a firstbacklight panel, (ii) a first horizontally polarized screen associatedwith one face of the first backlight panel, (iii) a first camera havinga lens, the camera having controllable frame rate and exposure, and,(iv) a first LCD screen; and further comprising (b) a second apparatuscomprising (v) a second backlight panel, (vi) a second horizontallypolarized screen associated with one face of the first backlight panel,(vii) a second camera having a lens, the camera having controllableframe rate and exposure, and, (viii) a second LCD screen.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings disclose exemplary embodiments in which like referencecharacters designate the same or similar parts throughout the figures ofwhich:

FIG. 1 is a schematic view of one exemplary embodiment of an apparatusaccording to the present disclosure.

DETAILED DESCRIPTION

Unless otherwise indicated, the drawings are intended to be read (forexample, cross-hatching, arrangement of parts, proportion, degree, orthe like) together with the specification, and are to be considered aportion of the entire written description of this invention. As used inthe following description, the terms “horizontal”, “vertical”, “left”,“right”, “up” and “down”, “upper” and “lower” as well as adjectival andadverbial derivatives thereof (for example, “horizontally”, “upwardly”,or the like), simply refer to the orientation of the illustratedstructure as the particular drawing figure faces the reader. Similarly,the terms “inwardly” and “outwardly” generally refer to the orientationof a surface relative to its axis of elongation, or axis of rotation, asappropriate.

FIG. 1 shows an apparatus (and frequency modulation numbers) accordingto one exemplary embodiment. A first apparatus comprising a screen and acamera combination is set up at a first location (A) and a secondapparatus comprising a similar screen and camera combination is set upat a second location (B). The camera at location (A) is fed to thescreen in location (B) and vice versa via a wireless connection over anetwork, e.g., the internet.

A user at each location walks up to the screen at his/her location andobserves the other person on the screen as if each was on either side ofa virtual glass, sharing a coplanar line of sight. In addition, wheneach user places his/her hand on their respective screen, their handsappear to touch, as size and perspective are preserved.

In exemplary embodiments, each apparatus consists of a camera, LCDscreen and a back light. In exemplary embodiments, the camera is of atype where frame rate and exposure can be externally controlled. Inexemplary embodiments, the camera is a microscopy-type camera. Inexemplary embodiments, the camera is a CCD camera Point Grey Dragonfly™,model BFLY-U3-13S2C-CS (available from Scientific).

In addition, the camera is equipped with a pinhole lens and mountedwithin the back light enclosure, exposing only the pinhole portion ofthe lens. The LCD screen is transparent or translucent and is mounted acorrect distance in front of the camera and back light to preserve aperceived “arms-length” distance. In exemplary embodiments, suchdistance may be a range of 24-30 inches. It is to be understood that thedistance can be adapted as needed. By having the camera shooting throughthe LCD screen which is “line-of-sight” and at perceived arms' length,users see one another as in normal conversation. Instead of appearing asif each one is looking “off camera” as with normal teleconferencing,their gaze is eye to eye. In exemplary embodiments, the back light is apanel with LED lights.

In order for a camera to shoot through a LCD screen without “seeing” thereverse image on the screen, the backside polarization layer is removedfrom the LCD screen. This allows the camera to view merely differingangles of polarization vis-a-vis the “twisting” action of the LCDmatrix. As no oppositional polarization layer exists to reveal pixels,the camera only perceives transparency.

From the perspective of the viewer of the LCD screen on the opposingside, the viewer should also see nothing but transparency and no imageas the polarization film is removed from the back side. The solution isto place the polarization film on the surface of the back light, whichis at an “arms-length” distance from the camera. In exemplaryembodiments, it is important that the polarization film covers all ofthe back light except the camera. The camera has an unimpeded view ofthe LCD screen.

In order for the camera to be able to capture through a ½ polarized LCDscreen (i.e., polarized in only one direction), without the wash ofreflected light from the back light hitting the back of the LCD screen,it is necessary to alternate the back light on/off and the cameracapture at a rate where flicker is not noticeable. A micro-controller isused to generate two synchronized pulse width modulated signals whereone signal modulates the back light at roughly 120 hz, while the othersignal triggers a camera exposure of, in one exemplary embodiment, about4 milliseconds every 33.33 milliseconds. The result is a camera thatcaptures at a nominal 30 FPS frame rate, while the LCD screen imageappears flicker-free.

The images or video stream from the apparatus at location (A) istransmitted to the apparatus at location (B) and fed into the onboardprocessor (which is part of each apparatus), which displays the streamonto the LCD screen of the apparatus at location (B).

The apparatus as described herein may be contained in a housing, withassociated power source(s), controller, and connection to a secondapparatus, e.g., an internet, WiFi or wired connection. In alternativeembodiments, the signal from a first apparatus may communicate with aremote central computer, which itself is also in communication with asecond apparatus. In exemplary embodiments, more than two apparatus canbe used.

The following describes one exemplary embodiment of a method/sequenceusing apparatus as described herein.

An apparatus comprising a camera, a LED backlight having a horizontallypolarized film associated with a front face (the backlight having apinhole aperture defined therein), a camera, and LCD screen with avertically polarized film associated with one face. The backlight andthe LCD screen are positioned to be separated by about 24-30 inches. Thecamera lens is positioned to be approximately at the same location asthe face of the backlight and/or horizontally polarized film. Thesecomponents are mounted in a housing, along with the associatedelectronics.

At 0-4.166 milliseconds: The back light is off. The camera capturesvideo through the LCD screen and vertically polarized film as theinterior of the housing is in a dark state and reflection from the backof the LCD screen is eliminated.

At 4.16-8.33 milliseconds: The camera no longer captures video and thebacklight projects through the horizontally polarized film, through theLCD screen, and through the vertically polarized film to display theimage (as with any LCD screen technology).

At 8.33-33.33 milliseconds: Only the backlight modulates during thisperiod, for a nominal frequency of 120 Hz, well above the eye'spersistence of vision.

At 33.33-37.49 milliseconds: The cycle repeats. The backlight is off.The camera captures video through the LCD screen and verticallypolarized film as the interior of the housing is in a dark state andreflection from the back of the LCD screen is eliminated.

Although only a number of exemplary embodiments have been described indetail above, those skilled in the art will readily appreciate that manymodifications are possible in the exemplary embodiments withoutmaterially departing from the novel teachings and advantages.Accordingly, all such modifications are intended to be included withinthe scope of this disclosure as defined in the following claims.

While the methods, equipment and systems have been described inconnection with specific embodiments, it is not intended that the scopebe limited to the particular embodiments set forth, as the embodimentsherein are intended in all respects to be illustrative rather thanrestrictive.

Unless otherwise expressly stated, it is in no way intended that anymethod set forth herein be construed as requiring that its steps beperformed in a specific order. Accordingly, where a method claim doesnot actually recite an order to be followed by its steps or it is nototherwise specifically stated in the claims or descriptions that thesteps are to be limited to a specific order, it is no way intended thatan order be inferred, in any respect.

This holds for any possible non-express basis for interpretation,including: matters of logic with respect to arrangement of steps oroperational flow; plain meaning derived from grammatical organization orpunctuation; the number or type of embodiments described in thespecification.

As used in the specification and the appended claims, the singular forms“a,” “an” and “the” include plural referents unless the context clearlydictates otherwise.

“Optional” or “optionally” means that the subsequently described eventor circumstance may or may not occur, and that the description includesinstances where said event or circumstance occurs and instances where itdoes not.

Throughout the description and claims of this specification, the word“comprise” and variations of the word, such as “comprising” and“comprises,” means “including but not limited to,” and is not intendedto exclude, for example, other additives, components, integers or steps.“Exemplary” means “an example of” and is not intended to convey anindication of a preferred or ideal embodiment. “Such as” is not used ina restrictive sense, but for explanatory purposes.

Disclosed are components that can be used to perform the disclosedmethods, equipment and systems. These and other components are disclosedherein, and it is understood that when combinations, subsets,interactions, groups, etc., of these components are disclosed that whilespecific reference of each various individual and collectivecombinations and permutation of these may not be explicitly disclosed,each is specifically contemplated and described herein, for all methods,equipment and systems. This applies to all aspects of this applicationincluding, but not limited to, steps in disclosed methods. Thus, ifthere are a variety of additional steps that can be performed it isunderstood that each of these additional steps can be performed with anyspecific embodiment or combination of embodiments of the disclosedmethods.

It should further be understood that the computer upon which the mobileapplication is running may be coupled to a plurality of communicationchannels that allow the computer to communicate with other computingdevices, e.g., servers, processors, etc. over, for example, one or morecommunication networks. As such, it should be understood thatcommunication channels are examples of communications media, whichtypically embody computer-readable instructions, data structures,program modules, or other data in a modulated data signal such as acarrier wave or other transport mechanism and include anyinformation-delivery media. By way of example, and not limitation,communications media include wired media, such as wired networks anddirect-wired connections, and wireless media such as acoustic, radio,infrared, and other wireless media. The term computer-readable media asused herein includes both storage media and communications media.

Further, the present method and system may also includecomputer-readable media for carrying or having computer-executableinstructions or data structures stored thereon. Such computer-readablemedia can be any available media that can be accessed by a generalpurpose or special purpose computer. By way of example, and notlimitation, such computer-readable media can comprise physical storageand/or memory media such as RAM, ROM, EEPROM, CD-ROM or other opticaldisk storage, magnetic disk storage or other magnetic storage devices,or any other medium which can be used to carry or store desired programcode means in the form of computer-executable instructions or datastructures and which can be accessed by a general purpose or specialpurpose computer. Computer-executable instructions comprise, forexample, instructions and data which cause a general purpose computer,special purpose computer, or special purpose processing device toperform a certain function or group of functions.

The following numbered clauses include embodiments that are contemplatedand non-limiting:

Clause 1. An apparatus for simultaneously recording a first live videostream and projecting a second live video stream onto an interactivetouch screen, the apparatus comprising: (a) a backlight panel; (b) ahorizontally polarized screen associated with one face of the backlightpanel; (c) a camera having a lens, the camera having controllable framerate and exposure; and, (d) a LCD screen.

Clause 2. The apparatus of Clause 1, further comprising a processor.

Clause 3. The apparatus of Clause 1, further comprising a receiver forwirelessly transmitting and receiving data.

Clause 4. A system for simultaneously recording a first live videostream and projecting a second live video stream onto an interactivetouch screen, the system comprising: (a) a first apparatus comprising,(i) a first backlight panel, (ii) a first horizontally polarized screenassociated with one face of the first backlight panel, (iii) a firstcamera having a lens, the camera having controllable frame rate andexposure, and, (iv) a first LCD screen; and further comprising (b) asecond apparatus comprising (v) a second backlight panel, (vi) a secondhorizontally polarized screen associated with one face of the firstbacklight panel, (vii) a second camera having a lens, the camera havingcontrollable frame rate and exposure, and, (viii) a second LCD screen.

It should further be noted that any patents, applications andpublications referred to herein are incorporated by reference in theirentirety.

What is claimed is:
 1. A method for simultaneously recording a firstlive video stream and projecting a second live video stream onto aninteractive touch screen comprising: with an apparatus having abacklight panel with a horizontally polarized screen on one face of thebacklight panel, wherein the backlight panel is switchable between an onmode and an off mode, and an LCD screen having a polarization layer onthe front side of the LCD screen, wherein the LCD screen polarizationlayer is oppositional to the backlight panel polarization screen: a)capturing by a camera an image through the LCD screen and verticallypolarized film at a first time with the backlight off; and b) projectingthe backlight through the horizontally polarized film, the LCD screenand the vertically polarized film to display an image at a second timewith the backlight on.
 2. The method of claim 1 further comprising: witha controller generating two synchronized pulse width modulated signalswherein one synchronized signal modulates the back light and the othersynchronized signal modulates a camera exposure time, wherein thesynchronized signals provide a flicker-free image.
 3. The method ofclaim 1 wherein data to perform at least one of the method steps aretransmitted and received wirelessly.
 4. The method of claim 1 furthercomprising transmitting the image to a first location to be displayed onthe LCD screen.
 5. The method of claim 1 further comprising: with at asecond location with a second backlight panel with a horizontallypolarized screen on one face of the second backlight panel, wherein thesecond backlight panel is switchable between an on mode and an off mode,and a second LCD screen having a polarization layer on the front side ofthe second LCD screen, wherein the second LCD screen polarization layeris oppositional to the second backlight panel polarization screen: a)capturing by a second camera an image through the second LCD screen andvertically polarized film at a first time with the backlight off; and b)projecting the backlight through the horizontally polarized film, thesecond LCD screen and the vertically polarized film to display a secondimage at a second time with the backlight on.
 6. The method of claim 5further comprising: with a controller generating two synchronized pulsewidth modulated signals wherein one synchronized signal modulates thebacklight and the other synchronized signal modulates a camera exposuretime, wherein the synchronized signals provide a flicker-free image. 7.The method of claim 6 further comprising: with a second controllergenerating two synchronized pulse width modulated signals wherein onesynchronized signal modulates the second backlight and the othersynchronized signal modulates an exposure time of the second camera,wherein the synchronized signals provide a second flicker-free image. 8.The method of claim 5 wherein data to perform at least one of the methodsteps are transmitted and received wirelessly.